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ABSTRACT 

The block bootstrap confidence interval based on dependent data can outper- 
form the computationally more convenient normal approximation only with 
non-trivial Studentization which, in the case of complicated statistics, calls 
for highly specialist treatment. We propose two different approaches to im- 
proving the accuracy of the block bootstrap confidence interval under very 
general conditions. The first calibrates the coverage level by iterating the 
block bootstrap. The second calculates Studentizing factors directly from 
block bootstrap series and requires no non-trivial analytic treatment. Both 
approaches involve two nested levels of block bootstrap resampling and yield 
high-order accuracy with simple tuning of block lengths at the two resam- 
pling levels. A simulation study is reported to provide empirical support for 
our theory. 

Key words and phrases: block bootstrap; coverage calibration; Studenti- 
zation; weakly dependent. 



1 Introduction 

The block bootstrap has been developed as a completely model-free proce- 
dure for handling inference problems concerning dependent data. A major 
criticism that impedes widespread acceptance of the procedure in applica- 
tions is that it lacks second-order accuracy and that empirical selection of 
block length is critical yet difficult. Although intensive work has been done on 
the second issue, remedies thus far proposed for the first drawback are rather 
restrictive in the sense that they require either non-trivial, and sometimes 
algebraically formidable, Studentization or assumptions of more stringent 
model structures. Those well-established techniques, such as the iterative 
bootstrap and the bootstrap-t, designed for enhancing bootstrap accuracy for 
independent data appear to have lost their appeal in the context of dependent 
data, because the block bootstrap series typically exhibits undesirable arte- 
facts as a consequence of pasting randomly selected data blocks together. 
An important question is whether the block bootstrap can be made more 
accurate, by an order asymptotically as well as for finite samples, without 
analytically cumbersome Studentization nor having to confine applications 
to dependent data generated by specific processes. 

We investigate formally the applications of two general resampling-based 
techniques, namely coverage calibration and bootstrap Studentization, to 



the block bootstrap confidence intervals based on dependent data. A novel 
double bootstrap procedure is proposed for either coverage calibration or 
bootstrap Studentization to improve coverage accuracy of the block bootstrap 
beyond the first order. The procedure enables both techniques to retain 
the simplicity and generality they have already enjoyed when applied to 
independent data. 

Hall (1985) and Kiinsch (1989) introduce the block bootstrap as a fully 
nonparametric extension of the bootstrap to handle dependent data. Its 
consistency for distributional estimation is verified by Kiinsch (1989) and Liu 
and Singh (1992). Lahiri (1992) proves for ?T2-dependent data that the block 
bootstrap distribution of an adjusted Studentized sample mean is accurate 
to second order. Davison and Hall (1993) achieve similar results by kernel- 
based Studentization. Hall, Horowitz and Jing (1995), Gotze and Kiinsch 
(1996) and Zvingelis (2003) sharpen the results by giving explicit orders for 
the estimation error. 

Variants of the block bootstrap include circular block resampling (Politis 
and Romano, 1992), the stationary bootstrap (Politis and Romano, 1993), 
the matched-block bootstrap (Carlstein, Do, Hall, Hesterberg and Kiinsch, 
1998) and the tapered bootstrap (Paparoditis and Politis, 2001). Lahiri 
(1999) compares the first two with the block bootstrap and confirms supe- 
riority of the latter. Davison and Hall (1993), Choi and Hall (2000) and 



Biihlmann (2002) remark on the distortion of dependence structures in block 
bootstrap series and, for that reason, express doubt over effectiveness of cov- 
erage cahbration by bootstrap iterations. 

The subsamphng method, as studied by Pohtis and Romano (1994), is 
more generally applicable than the block bootstrap, but has inferior asymp- 
totic properties: see Hall and Jing (1996) and Bertail (1997). Nonparamet- 
ric methods more accurate than the block bootstrap have been found under 
more stringent assumptions on the data generating processes. Examples in- 
clude the sieve bootstrap (Biihlmann, 1997; Choi and Hall, 2000) for linear 
processes, the Markov bootstrap (Rajarshi, 1990) and the local bootstrap 
(Paparoditis and Politis, 2002) for Markov processes. 

We introduce in Section 2 a double bootstrap procedure for either cov- 
erage calibration or Studentization of the overlapping block bootstrap. Sec- 
tion 3 establishes asymptotic expansions for the coverage probabilities of 
both the iterated block bootstrap and Studentized block bootstrap confi- 
dence intervals under sufficiently general regularity conditions, derives the 
optimal second-level block length in relation to the first-level block length 
and proves asymptotic superiority of our procedures. Section 4 reports a 
simulation study which compares our methods with the conventional block 
bootstrap and two alternative bootstrap-t approaches. Section 5 concludes 
our findings. All technical proofs are given in Appendix 16.11 



2 Coverage calibration and Studentization 

2.1 Block bootstrap confidence interval 

Let X = (Xi,...,X„) be a series of rf-variate observations from the se- 
quence {Xi : —oo < i < oo}, which is a reahzation of a strictly stationary, 
discrete-time, stochastic process with finite mean n = K[Xi]. Denote by 
X = J2^=i ^i/''^ the sample mean. 

We briefly review the block bootstrap construction of a level a upper con- 
fldence bound for a scalar parameter of interest 6 = H{fi), for some smooth 
function H : W^ ^ M.. A natural plug-in estimator of ^ is ^ = H{X). This 
smooth function model setup encompasses a wide variety of estimators, or 
their high-order asymptotic approximations, providing a sufficiently general 
platform for investigating the block bootstrap confidence procedure. 

For a block length i {1 < i < n),let n' = n — i + 1 and define overlapping 
blocks Yj^e = {Xj, Xj^i, . . . , Xj^i^i), j = 1, . . . ,n'. A generic first-level block 
bootstrap series X* = {X^, . . . ,X^^), where b = (n/i) and (x) denotes the 
integer part of x, is given by sampling b blocks randomly with replacement 
from {Yj^i : 1 < j < n'} and pasting them end-to-end in the order sampled, 
so that {Xf.^s^_^^, . . . , X*^) denotes the jth block sampled, j = 1, . . . ,b. 

Let P* and E* denote the probability measure and expectation operator 
induced by block bootstrap sampling, conditional on X, respectively. Define 



X* = '^i^iX*/{M) and the block bootstrap distribution function G*{x) = 
P* {{bey/^[H{X*) - H{E*X*)] <x),xeR. Then J(a) = 6 -n~^/^G*-\l- 
a) defines a level a block bootstrap upper confidence bound for 6. Note that 
sampling of overlapping blocks incurs an edge effect which explains the use 
of H{]K*X*), rather than the more conventional 6 = H(X), for centering the 
bootstrap estimator in the definition of G*. Under regularity conditions to 
be detailed in Section 3, the choice i oc n^^^ yields the smallest coverage 
error, of order 0(n^^/^), for 2(a). 

2.2 Second- level block bootstrap 

For independent and identically distributed data, coverage calibration and 
Studentization provide two well-known techniques for improving coverage 
accuracy of bootstrap confidence intervals. We consider applications of the 
two techniques in the present context of dependent data. Both coverage 
calibration and the version of Studentization proposed herein call for a double 
bootstrap procedure as described below. 

Based on X*, define blocks F,*,. ^ = (X*_,),^^., X*„,),_^^.^„ . . . , X*_i)^+,+fc_i), 
each of length k (1 < k < i), for i = 1, . . . ,b and j = !,...,£', where 
i' = i - k + 1. Note that for each fixed i = 1, . . . , 6, Y*-^^^, . . . , Y-y^^ repre- 
sent overlapping blocks within the block {XZ^y_^_^, . . . ,X*^), which is itself 



sampled randomly from the blocks {Yj£ : 1 < J < n'}. The second-level 
block bootstrap series, denoted by X** = (X**, . . . ,X*^), for c = {n/k), is 
sampled from the bi' blocks {Y*- j^ : I < i < b,l < j < i'} in the same way 
as is X* from {Y^-£ : 1 < j < n'}. That F^j;. is a subseries of k consecu- 
tive observations within X eliminates the possibility of drawing second-level 
blocks that run across joints of the first-level block bootstrap series, thereby 
avoiding the discontinuity problem which has aroused forejudged criticisms 
about the very usefulness of the double block bootstrap. 

Denote by P** and E** respectively the probability measure and expecta- 
tion operator induced by second-level block bootstrap sampling, conditional 
on X*. Define X** = T.ti^i*/ick) and 

G**{x) = F** {{cky/^[H{X**) - H{E**X**)] < x) , xeR. 

The second-level block bootstrap distribution G** can be used in two different 
ways, namely coverage calibration and Studentization, to correct X(a): 
1. Coverage calibration — 

The coverage calibration method adjusts the nominal level a to a, ob- 
tained as solution to the equation 



P* {{biY/^[H{X*) - H{E*X*)] < G**-\l -«))=! 



a. 



The coverage-calibrated upper confidence bound is then Tc{a) = 2r(d) 
e-n-^/^G*-\l-a). 



2. Studentization — 

Let f be the conditional standard deviation of (MY'^H(X*) given X, 
and T* be that of {cky/^H{X**) given X*. Define, for x e R, J*{x) = 
P* {{biy/'^[H{X*) - H{E*X*)]/t* < x). The level a Studentized upper con- 
fidence bound is then given by Ts{a) = 9 — n^^^'^fj*^^{l — a). 

We show in Section 3 that under regularity conditions, Tc{a) and Tsict) 
are asymptotically equivalent up to order Op (A;~^n~^/^ + £n^^/^) . Both 
methods enjoy a reduced coverage error of order 0{n^^^^) if we set, for ex- 
ample, 2k = i (X n^/^. Our results rebut the criticisms expressed by, for ex- 
ample, Davison and Hall (1993), Choi and Hall (2000) and Biihlmann (2002) 
over the effectiveness of coverage calibration. Indeed, Xc(q;) is the first ever 
non-Studentized block bootstrap interval having the same order of coverage 
accuracy as has previously been shown to be possible only with Studentiza- 
tion under the present regularity conditions. This has especially important 
implications for problems in which Studentization is found to be numerically 
unstable and therefore results in highly variable interval endpoints. On the 
other hand, construction of Ts{a) makes unnecessary all those non-trivial, 
problem-specific, algebraic manipulations which are instrumental to calcu- 
lation of the Studentizing factors suggested by Lahiri (1992), Davison and 
Hall (1993) and Gotze and Kiinsch (1996). Indeed, both f and r* are readily 
obtained by direct Monte Carlo simulation from the bootstrap distributions 
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G* and G** respectively, thus adhering most closely to the celebrated plug-in 
principle underlying the very bootstrap methodology. 

3 Theory 

Higher-order asymptotic investigation of coverage accuracy of the block boot- 
strap confidence bounds is possible if we assume regularity conditions that 
facilitate Edgeworth expansions of the distribution functions of n^^'^ip — 0) 
and 11} /'^ [6 — 6)/t. The set of conditions considered by Gotze and Hipp 
(1983) has generally been accepted as the standard assumptions underpin- 
ning a high-order asymptotic theory of the block bootstrap. Importantly, 
previous studies have shown that the block bootstrap can be made accurate 
to second order only with non-trivial Studentization or substantial strength- 
ening of the Gotze and Hipp conditions. We shall establish asymptotic results 
for our coverage calibration and Studentization approaches under the Gotze 
and Hipp conditions, as modified by Lahiri (2003, Section 6.5) below, with 
II ■ II denoting the usual Euclidean norm: 

(Al) E||Xif5+'5 < 00 for some 5 > 0. 

(A2) lim„^oo Gov [n^^^"^ XlILi -^-i) exists and is nonsingular. 



(A3) There exists a constant C G (0, 1) such that for i, j > 1/C, 
inf \ s^Cov j ^ XJ s : ||s|| = 1 I > Cj. 

(A4) There exist a constant C > and sub-o"-fields "Doi ^±i) • • • of the a- field 
underlying the probability space induced by Xi such that for i,j = 
1,2,..., 

(i) there exist P^^j-measurable random vectors Xjj satisfying E||Xj — 
^i,j\\ ^ C^^C^^^ for j > 1/C, where T>^ denotes the sigma-field 
generated by {Vt '■ r < t < s}; 

(ii) \F{AnB)-¥{A)F{B)\ < C-^e'^^ for any A e Vi^ and B e V^^; 



fiii) E 



E 



exp(isT Y.'r%-j Xr) \{Vt:t^ 2}J < e-^ for i> ]> 1/C 
and s G M'^ with ||s|| > C, where l^ = —1; 

(iv) E \¥{A \{Vt:t^ i}) - ¥{A \ {Vt : < \t - i\ < j + r})\ < C-^e~^^ 
for r = 1,2,... and AG 1)^+;. 

Note that (A4) introduces an auxiliary set of sub-a-fields Vt to bring a wide 
variety of weakly dependent processes under a common framework. Special 
examples include linear processes, m-dependent shifts, stationary homoge- 
neous Markov chains and stationary Gaussian processes. 

Bhattacharya and Ghosh's (1978) smooth function model supplies a rich 
class of estimators and has been extensively studied in the bootstrap liter- 
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ature: see, for example, Hall (1992). In the dependent data context, it en- 
compasses estimators such as sample autocovariances, sample autocorrelation 
coefficients, sample partial autocorrelation coefficients and Yule- Walker esti- 
mators for autoregressive processes. Importantly, the model admits highly- 
structured asymptotic expansions to facilitate establishment of Edgeworth 
expansions and their block bootstrap versions. We adopt the smooth func- 
tion model as described by Gotze and Kiinsch (1996) under the assumption 

(A5) if : M^ ^ M is four times continuously differentiable with non- vanishing 
gradient at fi and fourth-order derivatives at a; G M'^ bounded in mag- 
nitude by C(l + ||a;||''^) for fixed constants C,D > 0. 



Next we introduce some notation. Write x = {x^^\ . . . , x^'^'^) for each x G 
R"'. Define, for ri, r2, . . . = 1, . . . , rf and ii,i2,... = 0, 1, 2, ... , Yi^^il'.'.'.' = 
E [(Xo - fiY'-'KX,, - iiY'-'KX,, - ^)('-3) . . .] . For r, s, . . . = 1, . . . , d, define 
Hr = ((9/(9xW)i7(a;)|^^ , Hrs = ((9V(9xW(9a;W)i7(a;)|^^ , etc. Under con- 
ditions (A1)-(A4), we can expand the variance-covariance matrix of S'„ = 
n-'^'EtliX^ - /i) such that Gov (s^^ Si^^) = xZ + n^'x^ + ^(n-^), 
r, s = 1, . . . , (i, for constants x^\ and X2 2 '^ot depending on n. In particular, 
we have x^i = Z]i^-oo7i"''*- Define a"^ = Var f X]r=i -^^'S'„ M, which, under 
the above conditions, is positive and has order 0(1). Let </){■) and z^ be the 
standard normal density function and ,^th quantile respectively. 
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Our main theorem below derives expansions for the coverage probabihties 
of the various block bootstrap upper confidence bounds. 

Theorem 1 Let {Xi : —oo < i < 00} be a strictly stationary, discrete- 
time, stochastic process with finite mean /i = E[Xi]. Let a G (0, 1) be fixed. 
Assume that conditions (A1)-(A5) hold. Then, 

(i) for i = 0{n^^^) and i/n'' -^ 00 for some t G (0, 1), 
¥{9 < 1(a)) 

d 

= a + r'2-'a-^Za<p{za) Yl HrH^x^ ' n~'/^2-'a-hl<P{z^) 

r,s=l 

{d 00 d 

Y, HrH.H, Y llf + 2 E H,.H,H,^xZxZ 
r,s,t=l i,j=~oo r,s,t,u=l 

+ 0{r^ + in-'); (1) 

(a) for k < i = 0{n^^^) and k/n'^ -^ 00 for some e G (0, 1), the confidence 
limits Tc{(y) and Ts{a) differ by Op (A;~^n~^/^ + in~^/'^^ and have cov- 
erage probability 

d 

a + {2r^ - k-^)2-^a-^Za(p{za) J2 ^rHsXi^ + O {k-^ + in-^) . (2) 

r,s=l 

It is clear from Theorem [1] that X(a) has coverage error of order 0{i^^-\-£n^^), 
which can be reduced by either coverage calibration or Studentization to 
0(^~^ + in~^) if we set k = i/2. Heuristically, a chief source of coverage 
error of X(a) stems from the large bias, of order 1/i, of the block bootstrap 
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variance estimator. The second-level block bootstrap variance estimator has 
leading bias of order 1/k — l/ 1 when viewed as an estimator of the first-level 
block bootstrap variance estimate. Existence of such second-level bias term 
enables either the coverage calibration or Studentization strategies to auto- 
matically offset the first-level bias of order 1/^, provided that k is set to ^/2. 
Furthermore, expansions ([1]) and ([2]) enable us to derive the optimal choices 
of block lengths £ and k for achieving the best coverage error rates. We see 
from ([T]) that, in the absence of coverage calibration or Studentization, the 
optimal block length (. should have order n}^^ in order to yield the smallest 
coverage error, of order 0{n~^/^)^ for X(a). With k = i/2 and i oc n^^^, 
the coverage error of both Xc(a) and Isicn) has order 0(n^^/^), a signifi- 
cant improvement over that of the unmodified I{a). The following corollary 
summarizes the above results. 

Corollary 1 Under the conditions of TheoremUi 

(i) X(a) has coverage error of order 0{n^^^^), achieved by setting £ oc n^^^; 

(a) Tc{ci) and Ts{q) are asymptotically equivalent up to order Op{n~'^/^) 
and have coverage error of order 0(n^^/^), achieved by setting 2k = 

Corollary [T] confirms that second-order correction of the block bootstrap in- 
terval can be achieved by straightforward application of either coverage cal- 
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ibration or Studentization. Previous approaches proposed in the hterature 
to such second-order correction rely invariably on explicit computation of 
a non-trivial expression of the Studentizing factor, which must be analyti- 
cally derived for each smooth function model under study. See, for example, 
Hardle, Horowitz and Kreiss (2003) for a review of such approaches. At the 
expense of computational efficiency incurred by the double bootstrap proce- 
dure, calculation oi Ic{<y) or Is{(^) involves no analytic formula and can be 
carried out by brute force Monte Carlo simulation. Perhaps surprising is the 
extremely simple relationship {k = £/2) between the optimal first-level and 
second-level block lengths, which relieves us of the notoriously difficult task 
of determining the best block length for the double block bootstrap, in so far 
as the selection of k is concerned. 

4 Simulation study 

We conducted a simulation study to investigate the empirical performance 
oi Tc{a) and Ts{a) in comparison with X(a). Two other Studentized block 
bootstrap confidence bounds, based on constructions of Davison and Hall 
(1993) and Gotze and Kiinsch (1996) and denoted by 2DH{oi) and Xgx(«) 
respectively, were also included in the study for reference: see Appendix 16.21 
for details of these two latter approaches. Time series data were generated 
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under the following three models: 

(a) ARCH(l) process: Xi = 6^(1 + 0.3X2_Ji/2^ 

(b) MA(1) process: Xj = Cj + 0.3ej_i, 

(c) AR(1) process: Xj = 0.3Xj_i + Cj, 

where the e, are independent X(0, 1) variables. The parameter 6 was taken to 
be the mean, variance and lag 1 autocorrelation, and the nominal level a was 
set to be 0.05, 0.10, 0.90 and 0.95. For each method, the coverage probability 
of the level a upper confidence bound was approximated by averaging over 
1000 independent time series of length n = 500 and 1000. Construction of 
each confidence bound was based on 1000 first-level block bootstrap series 
using block length i = {n^^^), in addition to which 1000 second-level series 
based on block length k = {i/2) were generated from each first-level series to 
construct 2c{(y) and 2s{a). Specifically, we have {i,k) = (8,4) and (10,5) 
for n = 500 and 1000 respectively. The constant c was set to be 0.5 in the 
calculation of the Studentizing factor for Xgk{c()'- see Appendix 16. 2[ 

The coverage results are given in Tables [TH3] for the mean, the variance 
and the lag 1 autocorrelation cases respectively. In general, coverage calibra- 
tion and all three Studentization methods succeed in reducing coverage error 
of T(«) when the latter is noticeably inaccurate such as for 6 = Var(Xi). Our 
proposed Ic{o) and Is{<y) either outperform or are comparable to Idh{(^) 
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and XcKioi) in the variance and lag 1 autocorrelation cases. Note that Xgk{o') 
is exceptionally poor for small a in the autocorrelation case. All five confi- 
dence bounds have similar performance when 9 = E[Xi]. 

5 Conclusion 

We have proposed two double bootstrap approaches, one for calibrating the 
nominal coverage and the other for calculating the Studentizing factor, to 
improving accuracy of the block bootstrap confidence interval. The main 
advantage of the proposed approaches lies in the ease with which the second- 
level block length k can be determined, namely half the first-level block 
length, and the Studentizing factor can be computed, essentially by a trivial 
application of the plug-in principle. Not in the literature has the same degree 
of improvement been achieved without analytic derivation of the Studentiz- 
ing factor in a highly problem-specific manner. The problem of empirical 
determination of the first-level block length i has been dealt with by var- 
ious authors but methods which have proven satisfactory performance are 
not yet available. Both theoretical and empirical findings suggest that our 
proposed coverage calibration or Studentization approaches are effective in 
reducing coverage error even in the absence of a sophisticated data-based 
scheme for selecting £ in the confidence procedure. While implementation 
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of the approaches is analytically effortless, the only price to pay is the extra 
computational cost induced by the second level of block bootstrapping. 

Although our focus is confined to the smooth function model setting, it 
is believed that similar results extend also to von Mises-type functionals as 
well as to estimating functions, after appropriate modifications of the proof 
of our main theorem. Extension to dependence structures outside the present 
framework, such as series exhibiting long-range dependence, is less trivial and 
worth investigating in future studies. 

6 Appendix 

6.1 Proof of Theorem [T] 

We first state a few lemmas concerning moments of centred sums of stationary 
observations and their bootstrap counterparts. 

Define S"* = (biy/^ {X* - E*X*) and S"** = (cA;)V2 (x** - E**X**). De- 
fine, for i = 0, ±1, . . . and r = 1, 2, . . ., Zj = Xj— /i and Vi^r = r^^^'^ X^S^ ^s- 



Lemma 1 Under the conditions of TheoremUl we have, for r = 1,2,3,4 
and si,S2,...,Sr = l,...,d, Var (j^ti ^If ■ ■ ■ V^f^ /n'^ = 0(£r2-i). 

Lemma [U follows immediately from Lemma 3.1 of Lahiri (2003, Section 3.2.1). 
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Lemma 2 Under the conditions of Theorem [H, we have, for r, s, t, u 



1, . . . , d and as m ^ oo, 



E 



' l,m "^ l,m 



E 



' l,m ' l,m ' l,m 



E 



' l,m ' l,m ' l,m "^ l,m 



r.s I —1 r,s I ,0/ — 2\ 

X2;i + "^ X2,2 + C'(m ), 
X4:f" + 0(m-i), 



where X2'i; X2'2 '^^^ Xs'i ^^^ constants independent of m, and Xi 



r,s,t,u 



r,s t,u I r,t s,u , r,u s,t 
X2, 1X2,1 ~r X2, 1X2,1 ~r X2, 1X2,1- 



Lemma [2] can be established using arguments similar to those for proving the 
univariate case: see Gotze and Hipp (1983). 

A generic first-level block bootstrap series X* can be represented as the 
ordered sequence of observations in {Yni/, ■ ■ ■ , yN^/), where Ni, . . . ,Ni, are 
independent random variables uniformly distributed over {1,2, ... ,n'}. De- 
fine, for i = 0, ±1, . . . , r = 1,2, . . . and Si,S2, . . . ,Sr = 1, . . . ,d. 









i=\ 

and P^i'-.«. = YJ"^^^ v^.(|i) . . . V.^f Vn'-E [v/"/^ ■ ■ ■ v[f\ . Write l = min(f , A;) 
and i = max(i", k). 
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Lemma 3 Under the conditions of Theorem{l[ we have Q^i'---'**'- = Op (n -"^/^/c-"^/^) 
and Q'^'-''^ = Op{n-^''^{d/ef'A for r = 1,2,3,4 and si,S2, . . . ,Sr = 



l,...,d. 



Proof of Lemma O 

For r, s, . . . = 1,. . . ,d and — cx) < ii,i2, ■ ■ ■ < oo, write C\%','... = ^h ^i2 ' ' ' 

and ^1;%;... = ^[;%;... - E^[;%;...- Consider first 

i,j=l ii,...,vjivjV=0 

L j = l i2,...,ir,jl,---,jr=0 J 

which follows by stationarlty of the series {Zj : — oo < j < oo} and a 
backward shift of i + ii units. Under the assumed mixing conditions, the last 
expectation has order 0{n~^) for arbitrarily large K If the observations In 
6iVo"'''i and &1''''''' ,•_,,• are at least iiTlogn units apart. We can therefore 
restrict, up to 0{n~^), the first sum to that over j = l,...,i, so that 
EiQl^'-''"-)^ has order 



fc-i 

^Si,...,Sr,Si,...,Sr 
\,i2,...,ir,jl,--;jr 
*2,---,«r,jlv,ir = 



*2,---,«r,jlv,ir = 



Noting that 



n 
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we have Q-i-..,^,- = Qp (b-^^^ii/i'y/A = Op {n-^'\d/l'f'A. 
Using similar arguments, we see that 



i-i 



fc-i 



i=0 i2,...,ir,jl,---,jr=0 
k-1 



Olk-^nn')-' E ^K 



',Sl,...,Sr 
r2,...,ir,jl,--;jr\ 



i2,...,ir,jl,---,jr = 



SO that Q 



Sl,...,Sr 



Op{{k/n'y^'). 



0{k/n'), 
I 



Lemma 4 Under the conditions of Theorem U\, we have, for r,s,t, 



u 



l,...,d, 

E* [Sf^S*^^'^Sf^] 
Tff* rc*('') c*('') c*(*) c*('*)i 

^ L^n '-'n '-'n ^n J 



E [S[:^S^:^S[l^] + Op{in-^ + rin-V2), 



Proof of Lemma [^ 

Note first that, by LemmaE P^ P^•■^ P^''"-* and P'''^'*-" have order Op(£i/2^~i/2) 

for r, s, t, u = 1, . . . , (i. Lemma [2] then imphes that 



E* [5*(")5*(")] = P"'^ + E W^'^Vl 



KOt/(^) 



pr ps 



P^'' + xZ + t-^xi^ + Op{ln-' + r'). 



By Lemma [2] again, we have E 
follows. 






X2 1 + 0(72 ^) and the first result 
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Similarly, the second and third results follow by noting Lemma [2] and that 
and 

Tr^* r q*{r) q*{s) C*{t) C*{u)~\ 

= b-' {x4:f " + 0{e~') + Opif/^n-'/')} 

+ (1 - b-') {xZxt + xZxTi + xTixi + 0,{r' + i'/'n-'/')} 

I 

A generic second-level block bootstrap series X** can be identified as the 
ordered sequence of observations in {Yj\j^f., . . . , Y/t,Jc,fc) = (^iVii+Ji,fc> • • • > ^iVi,+Jc,fc), 
where the Ij and Jj are independent random numbers distributed uniformly 
over {1, 2, . . . , 6} and {1, 2, . . . , £'} respectively, both independently of {Ni, . . . , Nf,). 
Thus we can write 5^ = c-^/^ ^;=^^ V^^^+j^.,,,-c'/\M')-' Eti E -Li VN„+j-i,k. 



Lemma 5 Under the conditions of Theorem U\, we have, for r, s, t, u 
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l,...,d, 



TT^** r Q**(r') c**('5)1 

Trp** rQ**(T') Q^*{s) Q^*{t) Q**(w)l 

JH [D„ D„ D„ D„ J 



E* [Sl^'^ Sl^'^ Sl^'^ Sl^""^] + Op{t'''n~^''' + k~'). 



Proof of Lemma [B 

It follows from Lemmas [2] and O that 






-{Q' + Q'){Q' + Q 



g'^'^ + g'^'^+E[5M5(^)]+A;-v2:2 



-^00 1 01 



■^Op [k^'^ + n'^k + n 



The first result then follows by subtracting the expression for E* 
stated in Lemma HI 

Similar arguments show that 



Q*(r) (~,*(s) 
On On 



jg** r^**(r)^**(s)^**(t)l _ ^-1/2 Jjg 



+ Op (k-^n-^/^ + kn-^ + n-i(H£7^')'^' 
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and 



TT71** rr<**(r) c**(s) c**(t) c**(«)l _ ^/^'^ ^J^''^ i ^/>'t -.,'^:'" i ^/''^^y'^^^ 
JC. [D„ D„ D„ D„ J — X2,1A2,1 + A2,1A2,1 + A2,1A2,1 



which, on subtracting E* 



q*{r) q*{s) q*(t) 

iJn >Jn >Jn 



andE* 



;f*(r) n*{s) Q*(t) n*{u) 
Jn iJn *Jn *Jn 



as ex- 



pressed in Lemma HI yield the other two results. 



I 



Set Ln = Klogn for some large A' > 0. For r,s,... = l,...,d and 
— oo < p, q, i, ii, ^2, • • • < oo, recall the definitions of ^Ifl^',,, and ■CTi'^ia.... i^ the 
proof of Lemma [3l and split the sum Sn = Si^p^q + Si^p^q = Si^p + Si^p such that 



i~-'i,p,q "- 



\j-{i+p)\V\j-{i+q)\<L„ \j-ii+p)\<Ln 



Lemma 6 Under the conditions of Theorem Ui we have, for r, s, t, u 



L, . . . , I*, 



d, 



[n 



n' e-1 



(*") t^^'*) = 77-1/2 

p 



xZ + Op{in-'/' + n-'Ll/'), (4) 



in 



n' i-l 

4 = 1 p=0 



n' £-1 



[n 



vr^ V V ^'^ 9^*^ 

i=l p,q=0 



n 



'"'" E 7-f + Op(ri77-i/2L„ + £r7-i; 



lj=— 00 



(5) 



(6) 
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n' i-1 

(^'^)"' E E a;,.+.^ll^S. = 0,{in-'). (7) 

i=l p,q=0 

Proof of Lemma 

We outline the proof of (jH]) and ([7]); that of (jl]) and (jS]) follows by similar, 

albeit simpler, arguments. 

Consider first U^ ^ TtiKU^^''^'^ ^vM^zf . where Ef '"^ 
denotes summation over j satisfying \j — "iil V |j — 22! < -^n- Note that the 
variance of H^'** has leading term 

^^E E E E E 

k|<^ i |i'|<n' |p'|V|i3'|<^ j' 

\q\<l j |p'|V|g'|<^ j' 

= O \ n't max I f; E IC'/I ) i = 0{tn), 

u,v&{r,s,t} \ -^ '-^ ' / 

using stationarity properties and the fact that if both i' + p' and i! + g' differ 
by at least 3L„ from and g, then 



E (e-Z« - E[e-Zf ]) (0:,, ,^,,4^ - E[e':,, ,+,,z(f)]) = 0( 



n 



for arbitrarily large i^ > under the assumed mixing conditions. On the 
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other hand, 11^''' has mean 

p=0 g=-p j \q\<Ln \j-q\<Ln 

It follows that n[''^ has expansion Ti£Y^°°j^_^'yl'j' + 0{nLn) + Op{f'n^^'^), 
which yields ([6]) on multiplying it by n^^/^(n'£)^^. 

Consider next n[;^ = YlLi Ep7g=o SiS'*^''^ ^rfp.i+g^il j2 ' ^^^^h has mean 
of order 

^ OO CO ^ 

n'£ E E 1^ [^"o;^^':..] \ = o\ n'^' E ^ IC-I E E l^o"! = o{en) 

\q\<(. ji,J2 K. j=-oo i=-oo J 

and variance of order 

n'f y: e^°''^ e e'''"'^ 

\q\<i ji,J2 |p'|V|g'|<£ j[,j'2 



^ \^0,q^j[,J2 ^l^0,q^j[,J2\) \^p',q'^j\d!, ^^^P' ,q'^j\,j'2- 

l^ \q\,\p'\,\q'\<^ h,h j[,j'2 ) 

Thus ([7]) follows by multiplying Ilj'^ by (n'i)^^n^^. I 

Consider next the decomposition Sn = Sij^p^g + Sij^p^g = Sij^p + Sij^p such 
mat c>jj,p,g - n 2^^ Zt ana i^i j,p - n Z^|i_(i+j-i+p)|<L„ ^t' 

for — oo < p,q,i,j < cxd. Arguments similar to those for proving Lemma 
can be used to establish: 

Lemma 7 Under the conditions of Theorem U\, we have, for r,s,t,u = 
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l,...,d, 

n' (.' fc-1 

(^'^'^)-' E E E ^S-i+P'^a, = n-V^;,- + 0,{ln--'l- + n-^L]!% 

j=l j=l p=o 

n' £' fc-1 

(-'^'^)-^ E E E zn^-^^AlAl. = oAn-\ 

i=l j=l p=0 

n' £' fc-1 

[n I k) 2_^ 2_^ 2_^ ii+j^l+p,i+j~l+q<SiJ,p,q 
i=l j=l p,q=0 



' / J / J / J ^i+j~l+p,i+j-l+q'^i,j,p,q'^i,j,p,q ~ '-^p{kn ). 



n 

«j=— oo 
n' i' fc-1 

(n 

i=l j=l p,q=0 

We now proceed with the proof of Theorem [H 



Define Hrix) = {d/dx^'''^)H{x), Hrs = {d"^ /dx'^'^^dx^'^)H{x), etc., for 
r,s, . . . = 1, . . . ,d. Recall that we write Hr = Hr{fi), Hrs = Hrsifi), etc. for 
convenience. Note that /i^^) = E*X*(^) = £"i/2pr + ^{r)_ ^^j^g fj^ ^ Hr{fi), 
Hrs = Hrsifi'), etc. Taylor expansion shows that Var(ra^/^^) has leading 



term a^ = J2t,s=i HrHsE [sL"^Si'^\ . Define a^ = J^^^^^ HrHsW 
which can, by Lemmas [2] and HI be Taylor expanded to give 



n*{r) n*{s) 
On On 



a' = a'+ Y, HrHs [r^^^ + P^^^)+2r"^Y. HrHstxAP'+Op{^n"'- 



r\s=l r\s,t=l 



Lahiri (2003, Section 6.4.3) provides an Edgeworth expansion for the distri- 
bution function G of ti}/'^{6 — 6): 

G{x) = ^x/a) - n-^'^ [/C31 + lC^2{x^/a^ - 1)] (P{x/a) + 0{n-^), (9) 
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where /C31 and /C32 are smooth functions, both of order 0(1), of the moments 



E 



On ■ ■ ■ On 



ioT Si, . . . , Sr = 1, ■ ■ ■ , d and r = 2,3, 4, and $ denotes the 
standard normal distribution function. Lahiri's (2003) Theorem 6.7 derives 
a block bootstrap version of (JH]) under the conditions of our Theorem (T) 

G*{x) = ^x/a) - n-^/2 [/C31 + /C32(xVa2 - 1)1 0(a;/a) + Op(£n~^), (10) 

where /C31 and /C32 have the same expressions as /C31 and /C32 with the popu- 



lation moments E 



On ■ ■ ■ On 



Q*{si) Q*{Sr) 

On ■ ■ ■ On 



. With the 



replaced by E* 

aid of Lemma H] and the expressions ([8]) , ([9]) and (TTOj) , we can expand the 
difference between G*^^ and G^^ , so that, for ^ G (0, 1), 

P ('r2i/2(^ -e)< G*-\i)\ = P(T„ < y) + 0{in-^ + r^), (11) 

where T„ = ni/2(^_^)_^^(2a)-i (^^^^^^ iJ,i7,P-'« + 2ri/2^;^^^^^^ HrHstX^P' 
and y = G-i(0 +^"^^c(2a)-i ^^^^^^ HrHsXd^- Noting that P^ and P*^'" are 
Op{e'^n-^l^) by LemmaEl that ^^/^(^ -6) = Y1=i HuS^n'^ + Op(n-i/2) and 
expanding the characteristic function of T„ about that of n^/'^iO — 6), we get, 
for /3 e M, 



= -t/?25(2a)-^ ^i7,if,E 

r,s=l 



P^'^expL/5f^i7„^(")j 



./?^5a-V-i/2^if,/7,a2lE 



r',s,t=l 



P*expU/3^i:f„S(") 



M=l 



+ 0(£n 



-i> 



(12) 
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Note that for si, S2, S3 = 1, . . . , d, 



[n 



in\-l 



n' e-i 

i=l p,g=0 

n' e-1 



4=1 p,g=0 41,42, is 



{0,9), 



■^ |S4+p,4+qS4l,42,43 I 

0(£n-3/2L^). (13) 
It follows by expansion of the exponential function, ([6]), ([7]) and ( IT3l) that 



lg|<£ 41,42,43 



22,43 I 



E 



a;,4+,expL/3j]i7„5(") 



n' £-1 

'r'EE^ 

4=1 p,g=0 



44=1 



6/3 J2 HuS\i, + 2-1/3^ X^ H,H^sfl^s'~^l^ + exp ( -./3 J] //^^i^ 

44=1 



t,?4=l 



44=1 



n' £-1 



m 



'r'EEE 

4=1 p,g=0 



+ ./J,r'/^Eff'E^rE 

t=l i,j=— 00 
d 00 

t=l i,j=— 00 



44=1 



,4/3441/2(9-6 



+ 0(r^n-i/2^„ + ^n-i). (14) 



The last equality follows by the assumed mixing properties and noting that 
observations defining 5"}" and &f j , are at least L„ units apart on the series 



and that E ^, 



,+^,^, = 0. Noting that {n'l)-^ Y.ti K=o^ 



y{r) o(si) r,(s2) 0(^3) 
i+p i,p i,p i,p 



28 



0{n ^^"^Lll) for si, S2, S3 = 1, . . . , d, the same arguments show that 



r^/^E 



P*exp 6/?5^ff„^(") 



u=l 



./^n-^/^J^i/.xgE 



u=l 



,t/3ni/2(0-e) 



+ 0(£n-3/' + n-^Ly'). (15) 



Substitution of ^ and (USD into ([HD gives 

d 00 



s,t 



r,s,t=l 



ij=— 00 



r,s,t,u=l 

+ 0{in-^+r^n-^/^Ln). (16) 



It follows by inverse Fourier-transforming E e^^^" that 



F{Tn <x) = G{x) + n"^/^2-^a-^z^x(l){x/a) x 



J2 HrHsH, J2 <i ' + 2 E HrH^HsaZxZ 



r,s,t=l 



«J = — 00 



r,s,t,«=l 



+ 0(^n-^ + rin~i/2L„). 



(17) 



It then follows by combining (ITTj) and (TT7|) . setting x = y and noting that 
y = crzg + Oipr^l'^ + £"^) that 



P('ni/2(^-^) <G'*-i(0 



r,s=l 
d 00 d 

,r,s,t=l i,j=—oo r,s,t,u=l 

-2\ 



+ 0(£n-i + 
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which yields ([T]) on setting ,^ = 1 — a and taking complement. 

For proving (El), write /i* = E**X**, H; = Hr{fi*), H;^ = HrsifJ^*) etc. 



and define a*^ = Ers=i^r^sE*^ 



■Y**(r) Q**(s) 



. Note that, for r = 1, . . . , d. 



On Oi 

^<r) _ ^(r) _ ^-1/2 iQv ^ Qr\ _ £-i/2pr _ Opiji-^''^) by Lcmmas [U and El 
It follows by Lemma [5l and Taylor expansion that 



a 



*2 



O" 



+ ^ //,//, [q'^'^ + Q^'^ - P'-''* + [k-^ - r i)x2:' 



r,s=l 



+ 2 5^ if.if.a2f1 [^"'^' {Q' + ^0 - ^"'^'^*" 



r,s,i=l 



+ 0p(n-i£ + A;-2), 



using the fact that fi = jj, + Op{n ^/^). Denote by /C^^ and /C32 the versions of 



JC-i^ and JC-ir, with the moments E 



-32 



ri(si) ri(sr) 

^Jn ■ ■ ■ iJn 



replaced by E** 



Q**(si) Q**{Sr) 

On ' ' ' On 



in their definitions. Thus, by analogy with (ITUl) . we have 

G**ix) = $(s/a*)-n-i/2 [IC;^ + /C;2(a;V(T*2 - 1)] (pix/a*)+Opikn-'). (19) 

The expansions (fTOl) , (IT8l) , (iT9l) and the results in Lemma [5l enable us to 
expand G**^'^{^) about G*"^(,^) and write 

= F* {{Wf'^\H{X*) - HiWX*)] - a; < y) + Op(£n-i + A;-^), (20) 
whereA: = 6-iE-=i^^ 

f d d 



^r,s=l 



r,s,t=l 
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and 



'r,s=l 



+ 2 Y. H^H,aZ{k'"'"Q'-^'"'"P') 



r,s,t=l 



Define also Y* = ^J^^ ('v^jj'^^ - pA H^ for j = 1, . . . , 6, so that {Mf/^[H{X*)- 
H{WX*)] = 6~i/2 Y^b^^ Y* + Op(r2^i/2) ^y Taylor expansion. Note that the 
observations (Y*, R*) are independent, zero-mean and identically distributed 
with respect to first-level block bootstrap sampling, conditional on X. We 
see by Lemmalthat A; = Op{k^/^n-^/'^) and by (E]) that R* = OpHe/i'^^^), 
whereas Y* = Op{l) by Lemmas [U and El It follows that, conditional on X, 
{My/^[H{X*) - H{E*X*)] - a; and {My/^[H{X*) - H{E*X*)] have iden- 
tical means, variances differing by —2b^^/'^W[Y{Rl] + Op{kn^^) and third 
cumulants differing by -3b-^E*[YfRl] + Op{kn-^) = Op{in-^). Such cu- 
mulant differences can be employed to establish an Edgeworth expansion for 
{MY/'^[H{X*) - H{E*X*)] - a; analogous to (^, bearing in mind that /C31 
and /C32 stem from the first and third cumulants respectively: 

P* {{bey/^[H{X*) - H{E*X*)] - A*„ < x) 
= G*{x) + b-^/^a-^x(f){x/a)E*[Y*Rl] + Op{in-^). (21) 
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Note by Lemmas [T], [2] and [S] that for r,s,t = 1, ... ,d, 



Gov* (4;;,, Q?^; 



{s)t/(*)i 



[nik) £ Z_^Z_^Z_^Z_^ ^i+a,i+j-i+p,i+j-i+q 

1=1 jf=l a=0 p,g=0 



r /^s,t 



P'Q 



:22i 



Consider 



and 



£' i-1 k-1 

A^A^A^ ^^a,j'-l+p,j-l+q 
j=l a=0 p,q=0 

k-1 e-1 
= E E {(^-a)Af-(l-a)Vl + l}EC;; 

p,q=Oa=l-e' 

'k+0{L„) 

= E E {(^-«)A£'-(l-a)Vl + l} 

\p\,\Q\<Ln a=0{Ln) 



r,s,t 

q 



ip,q 



{ki' + 0{i'L^ + Ll)} Yl ^Z 



p,q=-oo 



n' (.' i-l k-1 



Var I {v!) ' E E E E ^I;'i+j-i+P,i+j-n 

j=l j=l a=0 p,g=0 

I ) «;« 2^ 2^ 2^ 2^ E |_Co',g^i'+a',i'+j'-l+p',i'+j'-l+g'J 

l«'l<"' |j'l<^' |a|,|a'|<£ kMp'M<?'l<fc 



n 



0<^nH£2^ 2^ 2^ IE|Co'gV',i'+i'-l+p',J'+i'-l+g'| 

li'l<^' l«'Ma|<^ |g|,|p'l,|g'l<fc 



o \ n-\hnf Y. E Id E ^ ICol E ^ IC'I 

|g|<fc |a|<^ |(?'l<fc 



-1^L/''/7N2\ 



o{n-\kn) 
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so that 

n' i' i-\ fc-1 

/-l+p,j+j-l+i3 



("r"EEEE«K.«-i- 



i=l j=\ a=0 p,(?=0 

oo 

= w Y, ilf + Op{e'L^ + Ll + ke'en~'/^). (23) 

Similar arguments show that 

Cor {v},% Q'^^) = {k/ey/'J2^^^'' + 0p{m-'^'L^ 

a=—OD 

+ ii'r\My'/^Ll + k^l'^n-^'^] . (24) 
Combining (I22])-(I24!), we have 

{d 00 

J2 HrHMt Yl <i'* 
r,s,t=l i,j=— 00 

d 

r,s,t,u=l 

+ Opii-'/^k-'L^ + {keyH-^I^Ll + e'^n-^l^). (25) 
Substitution of (^3|) into (!?I11 . setting x = y and noting (^0]) . we have 

= e + 2-V-^^^</)(;^5) I X^ iJ.i/. [Q^'^ - P'-'^ + (A:-^ - ri)xr2] 



r,s,t=l 

d oo 



\s,t 



+ n-V22-V-^40(.,)<j 5^ i/.if.iJ, J2 <i' 

^r,s,t=l i.j=—oo 

d 

+ 2 2^ HrHsHtuX2,lX2j 



r,s,t,u=l 
-1 , ;.-2n 
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inversion of which gives d = a + (5„ + i?„ + Op{in ^ + k ^), where 

d 

r,s=l 
d oo d "■ 



Bn 



\r,sA=l 



-2 V '^Za(l)(Za] 



i,j=—oo 



r,sA,u=l 



X 



J2 HrHs (g^'^ - rn + 2 5^ Hr.H,aZ {k~"^Q' - ^'"^P') 



, r,s=l 



r,s,t=l 



It follows from flTTj) that the coverage probability of Tc(a;) is 



1 - P (n^/^{e -e)< G*-^(l -a)\=l- P(f; < y) + 0{in-^ + A;-2), (26) 



where 



t„ = ni/2(^ - ^) + ^.(2a)-i Y. HrHsP''' + 2rV2 ^ H^H^aZP' 



\r,s=l 



+ a(t){z^) ^B„ 



d d 



■r,s=l 



r,s,t=l 
1 V-d 



and y = G-^l - " - -^n) - t^z^{2a)-^ 11^,^=1 HrHsX'-l'i- Similar to ^ and 



IHD, E 



g^'^expL/?n=i^«'5, 



(«) 



Q*expL/5ELi^«'^' 



(«) 



and A;-i/2E 

can be expanded by invoking Lemma [TJ so that the difference between the 
characteristic functions of T„ and n^^'^{9—6) can be established as in the proof 



of (1161) . This enables us to derive an Edgeworth expansion for T„ analogous 
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to (dZD: 

P(T„ <x) = G{x) - n-^l'^2-^a-^z^x(\){xla) x 

d oo d 

,r,s,i=l i,j=—oo r,s,t,u=l 

+0{in~^ + k-^n~^I^Ln). (27) 

The coverage expansion ([2]) for Tc{a) then follows by noting (l26ll . setting 
a; = y in ([27]) and Taylor expansion. 

It remains to prove ([2]) for the Studentized Ts{a). We see by Taylor 
expanding the smooth function H{-) and the moment relations asserted in 
Lemmas H and that f^ = 6-2 + Op{n-^ + in-^/'^) and r*^ = o-*2 + Op(n"^ + 
£^-3/2^ _ Expanding r* about a based on (ITSj) . we have, for ^ G (0, 1), 

r{z() = P* ((6£)i/2^i7(X*) - H{E*X*)] - a; < w) + Op(^n-i + A;-^), 

where A* is defined as in ( I20l) and 



s=l 

+ 2 X: H^H,aZik~'^"Q'-^''^"P') 



w 

.-r,s=l 



Noting ([2S]) and dHD, we have 



d oo 

X < Y HrHsH, Y ^f + 2 E HrHMtuxZiXTi 

^r,s,t=l i,j=—oo r,s,t^u=l 
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Recall the expression for d = a + (5„ + i?„ + Op{in ^ + k ^). Putting z^ = 
G*-i(l-a)/<T in dSHD, we verify that J* (G*-^ {I - a) / a) = 1 - a + Op{in-^ + 
A;-2), so that fj*-\l - «) = G*-\l - a) + Op{ln-^ + k-^). Thus Is{a) is 
equivalent asymptotically to Tc{(y) up to Op |n~^/^(£n~^ + A;"^)}, yielding 
for its coverage probability the same expression as given by ( l26ll up to order 
0(£n^^ + k^'^). This completes the proof of part (ii). I 

6.2 Other Studentizing approaches 

Under the smooth function model setting, Davison and Hall (1993) and Gotze 
and Kiinsch (1996) suggest Studentizing the block bootstrap based on closed- 
form expressions. Their constructions are similar to that of our Xs{a), ex- 
cept that f and r* are replaced by closed-form expressions depending on 
partial derivatives {H^} of H. Specifically, Davison and Hall (1993) define 
^' = Yfr,s=iHr{X)Hs{X)trs. whcrc trs = n'^ Y.tl{X^- Xf\X,- Xf^^ + 
n~^ Ei=l Y.lZi{Xi-X)^'-\Xi+j-XY'\ and r* analogously with X replaced 
by the block bootstrap series X* in the above definition of f. Gotze and 
Kiinsch's (1996) Studentizing factors have similar expressions except that 
they define %s = J2j=o'^j'^~^ Z]r=i (^« ~ XY^'KXi^j - X^-'^ where Wo = 1 
and Wj = 2{1 — c(j7£)^} for 1 < j < £ — 1 and some c > 0, and its bootstrap 

version by r^ E,U ^-^ {EIi(^0-i).+. - ^*)^'^^ } {EIi(^0-i).+. - ^*)^^^}- 
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n — 


500 






n = 


1000 




nominal level a 


0.05 


0.10 


0.90 


0.95 


0.05 


0.10 


0.90 


0.95 


(a) ARCH(l) series 


l{a) 


0.053 


0.099 


0.897 


0.943 


0.034 


0.110 


0.903 


0.939 


Ic{a) 


0.056 


0.096 


0.897 


0.942 


0.037 


0.113 


0.903 


0.936 


Is (a) 


0.052 


0.097 


0.898 


0.944 


0.034 


0.109 


0.901 


0.937 


lDH{a) 


0.053 


0.100 


0.899 


0.944 


0.033 


0.106 


0.902 


0.939 


lGK{a) 


0.052 


0.102 


0.899 


0.941 


0.036 


0.107 


0.902 


0.935 


(b) MA(1) series 


l{a) 


0.059 


0.088 


0.904 


0.948 


0.050 


0.104 


0.899 


0.952 


Ic(a) 


0.056 


0.086 


0.912 


0.951 


0.048 


0.096 


0.902 


0.952 


M^) 


0.053 


0.085 


0.914 


0.954 


0.044 


0.098 


0.904 


0.952 


lDH{a) 


0.052 


0.087 


0.912 


0.955 


0.048 


0.097 


0.902 


0.951 


lGK{a) 


0.053 


0.087 


0.908 


0.953 


0.046 


0.098 


0.900 


0.954 


(c) AR(1) series 


I{a) 


0.059 


0.104 


0.894 


0.937 


0.049 


0.108 


0.891 


0.934 


Ic(a) 


0.045 


0.096 


0.902 


0.941 


0.043 


0.104 


0.899 


0.939 


Is{a) 


0.045 


0.095 


0.902 


0.942 


0.041 


0.103 


0.899 


0.942 


lDH{a) 


0.046 


0.100 


0.902 


0.941 


0.045 


0.105 


0.896 


0.938 


lGK{a) 


0.046 


0.101 


0.902 


0.940 


0.043 


0.104 


0.899 


0.939 



Table 1: Mean example — coverage probabilities of nominal level a upper 
confidence bounds for mean, approximated from 1,000 independent series of 



length n. 







n — 


500 






n = 


1000 




nominal level a 


0.05 


0.10 


0.90 


0.95 


0.05 


0.10 


0.90 


0.95 


(a) ARCH(l) series 


l{a) 


0.025 


0.090 


0.840 


0.902 


0.028 


0.089 


0.828 


0.889 


Ic{a) 


0.053 


0.111 


0.887 


0.943 


0.054 


0.109 


0.869 


0.926 


Is (a) 


0.052 


0.112 


0.888 


0.944 


0.052 


0.106 


0.871 


0.926 


lDH{a) 


0.054 


0.114 


0.881 


0.940 


0.055 


0.108 


0.864 


0.924 


lGK{a) 


0.058 


0.113 


0.883 


0.942 


0.053 


0.110 


0.867 


0.927 


(b) MA(1) series 


l{a) 


0.046 


0.090 


0.883 


0.930 


0.056 


0.097 


0.872 


0.921 


Ic(a) 


0.059 


0.099 


0.906 


0.946 


0.064 


0.105 


0.884 


0.936 


M^) 


0.058 


0.100 


0.909 


0.948 


0.065 


0.105 


0.883 


0.935 


lDH{a) 


0.059 


0.101 


0.905 


0.944 


0.064 


0.105 


0.881 


0.938 


lGK{a) 


0.061 


0.103 


0.907 


0.944 


0.064 


0.105 


0.877 


0.937 


(c) AR(1) series 


I{a) 


0.042 


0.091 


0.885 


0.928 


0.047 


0.097 


0.863 


0.916 


Ic(a) 


0.053 


0.106 


0.903 


0.950 


0.059 


0.107 


0.881 


0.936 


Is{a) 


0.052 


0.104 


0.902 


0.953 


0.058 


0.110 


0.880 


0.932 


lDH{a) 


0.054 


0.104 


0.899 


0.952 


0.057 


0.109 


0.883 


0.930 


lGK{a) 


0.055 


0.107 


0.901 


0.949 


0.057 


0.108 


0.883 


0.927 



Table 2: Variance example — coverage probabilities of nominal level a upper 
confidence bounds for variance, approximated from 1,000 independent series 
of length n. 







n — 


500 






n = 


1000 




nominal level a 


0.05 


0.10 


0.90 


0.95 


0.05 


0.10 


0.90 


0.95 


(a) ARCH(l) series 


l{a) 


0.063 


0.103 


0.878 


0.930 


0.056 


0.098 


0.888 


0.930 


Ic{a) 


0.054 


0.096 


0.885 


0.937 


0.049 


0.098 


0.891 


0.934 


Is (a) 


0.054 


0.099 


0.884 


0.936 


0.052 


0.098 


0.890 


0.933 


lDH{a) 


0.057 


0.100 


0.883 


0.934 


0.058 


0.100 


0.888 


0.930 


lGK{a) 


0.049 


0.095 


0.878 


0.934 


0.054 


0.094 


0.887 


0.935 


(b) MA(1) series 


l{a) 


0.056 


0.095 


0.905 


0.952 


0.041 


0.084 


0.888 


0.947 


Ic(a) 


0.052 


0.087 


0.901 


0.953 


0.039 


0.078 


0.886 


0.944 


M^) 


0.052 


0.087 


0.899 


0.949 


0.037 


0.075 


0.884 


0.947 


lDH{a) 


0.051 


0.090 


0.903 


0.952 


0.041 


0.079 


0.886 


0.947 


lGK{a) 


0.022 


0.058 


0.920 


0.966 


0.026 


0.051 


0.914 


0.962 


(c) AR(1) series 


I{a) 


0.067 


0.110 


0.882 


0.941 


0.045 


0.101 


0.873 


0.936 


Ic(a) 


0.057 


0.100 


0.880 


0.941 


0.042 


0.093 


0.877 


0.935 


Is{a) 


0.055 


0.101 


0.881 


0.937 


0.039 


0.091 


0.878 


0.937 


lDH{a) 


0.060 


0.103 


0.882 


0.946 


0.044 


0.095 


0.873 


0.941 


lGK{a) 


0.025 


0.065 


0.897 


0.959 


0.023 


0.054 


0.899 


0.955 



Table 3: Autocorrelation example — coverage probabilities of nominal level a 
upper confidence bounds for lag 1 autocorrelation, approximated from 1,000 
independent series of length n. 



